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ABSTRACT 
The  parameter  estimation  methods  considered  in  this 
thesis  are  the  weighted  Least-Squares  and  Weighted  Huber 
for  some  non-linear  growth  models.   The  properties  of 
these  parameter  estimators  derived  from  simulated  data 
by  means  of  (1)  weighted  and  unweighted  least-squares 
and  (2)  weighted  and  unweighted  Huber  robust  estimation 
are  compared.   The  error  components  of  the  simulated  data 
are  long- tailed  and  non-normal.   The  performance  of  mis-spe- 
cified models  is  considered. 
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I.   INTRODUCTION 

The  properties  of  the  least-squares  estimator  for  the 
linear  model  are  well  known  [Ref.  2].   Among  its  important 
properties  is  that  it  has  minimum  variance  among  the  class 
of  linear  unbiased  estimators.   In  Chapter  II  the  properties 
of  the  least-squares  solution  for  JlnA  in  the  growth  model 

-B/t,  e(t-) 
Y(ti)  =  Ae     e       ti  =  l,2,...,n 

will  be  reviewed.   Then  the  estimate  A  and  its  statistical 
properties  will  be  derived  using  the  estimator  for  £nA  by 
means  of  the  Taylor  series  approximation.   Thus  the  emphasis 
will  be  on  estimation  of  the  "final  value"  of  the  growth 
process . 

The  least-squares  estimator  is  easy  to  compute  and  has 
desirable  properties  when  the  assumption  of  normality  is 
justified.   However,  many  of  the  properties  of  the  least- 
squares  estimators  are  not  robust  against  .non-normality  as- 
sumptions (Sheffe,  [3]). 

Recently  (Huber,  [1])  statisticians  have  shown  consider- 
able interest  in  finding  estimators  which  are  robust  against 
non-normality  of  error  assumptions.  Examples  of  non-normal 
distributions  of  interest  are  long-tailed  distributions  such 
as  a  mixture  of  two  normals,  and  also  the  double  exponential 
and  Cauchy.  Several  robust  methods  have  been  considered 
such  as  : 


1.  Using  the  median, 

2.  Jackknifing, 

3.  Trimmed  mean, 

4.  Huber  estimator. 

Of  these  methods  only  the  Huber  will  be  considered  in 
Chapter  III.   One  major  difficulty  with  the  Huber  estimation 
method  is  that  the  solution  process  leads  to  a  system  of 
non-linear  equations  which  cannot,  in  general,  be  solved 
analytically.   Although  some  asymptotic  properties  of  the 
Huber  estimator  have  been  derived,  the  small  sample  proper- 
ties must  generally  be  obtained  by  computer  simulation. 

Finally,  a  problem  is  said  to  be  misspecified  if  the 
data  comes  from  the  model 

ri   =  g(x,£l)  (1-1) 

but  the  model  used  is 

Y2  =  f(x,e2)  (1-2) 

where  the  functions  f  and  g  are  not  identical. 

Since  in  practice  the  true  model  is  not  known,  it  is 
important  to  know  how  good  are  the  fits  or  estimates  ob- 
tained by  using  reasonable  alternative  models.   In  Chapter 
IV  the  properties  of  several  mis -specif ied  model  fits  are 
compared  when  the  true  model  is 

Bt.     e(t.) 

Y<V  =  A  l-rit7e 

l 

for  A  =  1  and  t-  =  1,2, ...20  and  B  =  0.0772  using  computer 
simulation.   The  reason  for  choosing  B  =  0.0772  is  that  for 

10 


this  value  of  B,  the  largest  value  of  E (Y)  for  the  true  model 
is  0.6,  i.e.  60%  of  the  final  value  (A  =  1)  eventually  reached. 
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II.   LEAST- SQUARES  ESTIMATION  OF  InA   AND  TAYLOR  SERIES 
APPROXIMATION  OF  A 


A.   LEAST-SQUARES  ESTIMATION  OF  JlnA 
Consider  the  model 

Y  =  Ae"B/t  ee  (2-1) 

where  t  is  the  independent  variable,  Y  is  the  dependent  vari 
able,  and  e  a  random  variable. 

Let  the  n  pairs  of  sample  observations  of  Y  and  t  be 

(V  yi),  (t2,  y2),  ...  ,(tn,  yn). 

Assume  the  hypothesis 

E(£i)   =0       i  =  1,    ,n 

0    i  f   j 
E(e.e,)  =  (2-2) 

1  3       cr2   i  =  j 

The  distribution  of  &nA  and  the  approximate  distribution  of 
A  may  be  found  by  taking  logarithms  of  equation  (2-1),  i.e. 

in   Y  =  £n  A  -  B/t  +  e.         •  (2-3) 

The  properties  of  5,nA  can  be  derived  by  considering  the 
linear  model 

Z  =  a  +   3x  +  u  (2-4) 

where 

Z  =  In   Y,  a  =  £n  A,  B  =  -3,  x  =  1/t,  u  =  e. 
Assume  the  following  hypothesis  for  the  linear  model 

z.  =  a  +  3  x.  +  u.     i  =  1,2.. ...n 
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E(u.)  =  0         i  =  1, .  . .  ,n 

0    i  f   j 

ECuiU.)  =  (2-5) 

2 

°;    *  -  j 

where  a,  3  and.  a2  are  unknown  parameters.   The  principle  of 
least-squares  is  to  choose  estimates  a  and  8  of  a  and  8  such 
that  .2-  u2  is  minimized. 

The  estimates  a  and  8  are  given  by 

n      _     _ 

A    . En  (x- -x) (z . -z) 

3  =  1"1  n  X (2-6) 

.2-  (x.-x)2 

i=l  *•  i   -* 


where 


a  =  z  -  8  x 


—   1  n 

x  =  -  .Z1  x. 
n  i  =  l   i 


-       1  9 

z  =  —  .  £-,  z. 

n  i=l   i 


from  these  expressions  it  can  be  shown  that 

/v. 

E(a)  =  a 


n 
.S-  x2 

1=1    1        _2 


Var(a)  =   ^  x   i a2  .  (2-7) 

n.  I1  (x. -x) 2 
i=l  ■ v  i   ' 


B.   TAYLOR  SERIES  APPROXIMATION  FOR  THE  LEAST-SQUARES 
ESTIMATOR  A 

Let  X  be  a  random  variable  and  Y  =  f (X) ,  where  it  is 

assumed  that  the  function  f  can  be  expanded  in  a  Taylor  series 

about  E(X)  =  u;  that  is, 
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f(X)  =  £(U)  +  (X-y)f'(y)  +  0((x-y)2). 
Neglecting  the  higher  order  terms 

E(f(X))    -   E(    f(y)    +    a-v)f'(v)    ) 

■  £(y) 

Var(£(X))    *   E(    (f(X)    -   E(f(X)))2    ) 
■    E(    (f(X)     -    f(v))»    ) 

«  EC   (x-y)2   )•(£» (y))2.  (2-9) 

From    (2-3) 

z   =   In  Y   =    Jin  A    -    B/t   +    e 

and   from    (2-7) 

n 
•£-,    x? 

Var(£nA)    =   ^± — - —  a2    . 

n  _  e 

n.S-    (x.-x)2 
i=l    v   i      ' 

Using  the  relationship  A  =  e    and  the  results  of  (2-8) 
and  (2-9) 

y  =  E(X)  =  ink 
E(A)  a  ey 


VarCA)  =  (e*nA)'Var(AnA)  (2-10) 


n 

Z,  x? 


a  A2  i=i-i a2  . 

n  e 

Equation  (2-10)  shows  that  using  the  least- squares  method 
and  the  Taylor  series  approximation  the  variance  of  A  is 
directly  proportional  to  a2  . 
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As    an   example, 

for   t   =   1,2,. ..,20,    A  =    1,    and  B  =    10.0 

Var(A)    =   0.0841«Var(e) 
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III.   THE  HUBER  ESTIMATION  METHOD 

A.   THE  HUBER  ESTIMATOR  WITH  SCALE  UNKNOWN 

Although  least-squares  gives  the  best  linear  (in  the 
observations)  estimates  of  the  parameters  in  (2-3)  or  (2-4), 
non-linear  estimates  may  be  appropriate  when  the  error 
terms  (e's)  are  long-tailed,  as  is  often  true  in  practice. 
Various  principles  for  deriving  estimates  are  possible.   In 
this  thesis  an  estimator  due  to  Huber  [Ref.  1]  is  utilized. 

Prob  {y  <  Y  <  y  +  dy  } 
=  P  C  *~  )  |  dy  (3-1) 

where    Y  =  0  +  a  e 

p(z)  is  the  density  for  e. 

The  likelihood  function  for  the  observations  is 


,5,  EiPt^-)] 


The  log  likelihood  function 


L  =  J,  log[p(  -J-5-  )  |  ] 

n  Ya    '    6 

=  ■Z1    [  log  p  (  —l— - —  )  -  log  a  ] 


Consider 


y  -  e 
36  "  j=l     y.  -  6     l   a  J 

p  c  -J-^ ) 
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3a  -  j=l  L  T. 


3L    ?    P'C   Ja   )  Y*    -    9 


p  c  V) 

To  find  the  maximum  of  L  where  8  and  a  are  unknown  set  9L/8  9 
and  3L/3a  equal  to  zero. 

y     -   e 

n    P'  C   J  -    3 
•  Z1   2_ —  =  o 

P   (   3  =    )  (3  ^ 


Yt 

- 

6 

P1 

( 

J 

a 

) 

y.; 

- 

9 

P 

c 

^ 

a 

) 

1  n    Y,    -   e  . 


In  the  Huber  method  with  scale  unknown,  let 

*  p4f}  -  *Cz)  (3-3) 

for  some  function  ip  to  be  chosen. 

The  equations  can  be  written  in  the  form 


n     y.    -  9 


,   n     y.  .-  6    y.  -  6 
n  j  =  l  y  ^    a   JV-    a   J 

Example  1: 

Let  pCz)  =  —  e"z2/2 
/2? 

where  p  is  the  standard  normal  distribution.   Then 

p«  (Z)  =  -2   J_  e"z2/2 
/2tF 


17 


(3-4) 


The  likelihood  equations  can  be  written  in  the  form 

n     y,   -  e 

.E-  -  (  -1 )  =  0 

j=l    v    a   J 


y.  -  6    y.  -  9 


il^ViiV)-1 


which  simplifies    to 

6   =  -    .?..    y.    and 

a  in  a    „ 

•-       ijlj    C/3    -    •)'    • 

These  estimates  are  obtained  by  using 

*^  =  -  fr7r=  z  •  (3-5) 

Thus  the  estimates  with  the  normal  distribution  assumption 
come  from  the  use  of  i^(z)  =  z. 
Example  2: 

Let  p  be  Cauchy.   Then 

p(z>  "  m  *  z*j   and 
^  ♦«  -  -  fff}  =  rIV  • 

Forms  of  tp  that  are  generally  used 

HUBER  M 

-ka    z  <  -ka 

ip(z)  =        z    -ka  <  z  <  ka  (3-6) 

+ka    z  >  ka 
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SINE 

Sin(  |5-  )    |z|   <  Ictt 
<Kz)=  (3-7) 

0        otherwise. 
TUKEY 

kz(l  -  kz/a)   |z|  <  ka 
iKz)=  (3-8) 

0  |  z |  >  ka 

The  parameter  a  must  be  selected  with  reference  to  a 
scale  parameter  for  e. 

B.   ROBUST  ESTIMATION  OF  PARAMETERS 
Consider  the  linear  model 

y^  =  a  +  3(Xj  -  x)  +  e..    j .-  l,2,...,n 
E(ej)  =  0 


E(eiej)  =0   i  t   j 


E(e?)  =  a2. 

Let  the  scale  factor  be  a.   The  likelihood  function  for  the 
observations  is 

n     y,  -  a  -  B(x,  -  x)    - 

L  =  .II-  p(  -1 1 )•- 

j=l^        a  J    a 

_    1  n 

where  x   =  —  .Z1  x.  . 
n  j  =  l   j 

Differentiating  with  respect  to  a,  3,  and  a  and  equating 
each  derivative  to  zero 
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§JT  "  jfil   (  H  }  •  (-5  }   "  ° 


3L  ?  -  '  X;:    "    X 


jf  -    jSi    (   *p    )•(-!)•(   -4-)    =    0  .  (3-9) 

a I  n  o»  y.    -   a  -   8(x,    -  x)  - 

||=   fa   [(-!)(£-)•(  J ^ )    -   i]   =   0 

Let 

¥(z)    =    "    pt  fZ?    and 
v    '  P    (z) 

Tj    =   yj    -    a    -    3    (Xj    -    x) 

then  the  equations  (3-9)  can  be  written  in  the  form 
n     r. 


n      r.    r . 


j£i  W(-i)Cil-)  -  jr]  ■.<•• 


A  method  of  iteration  for  solving  the  system  of  non-linear 
equations  (3-10)  will  now  be  described.   First,  start  with 
initial  values 

a(0),  6(0),  a(0). 

Re-arrange  equations  (3-10):   the  first 

r . 
n     r.  n  ♦£  -t  ) 


;Ii  *(  — L  )  =  0   becomes  .1-  - —  •  r.  =  0 


and  the  second  equation 


i-t> 
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.Z1  iH  -J-  )(x.  -  x)  =  0  becomes  .E1  - —  (x.  -  x)»r.  =  0 

j  =  l  r  v  a  '  v  j     "*  j  =  l    r.    *■  j    '   j 


c-t) 


and  the  third  equation 

jtl   C*(  ^  )(  ^  )■-  |  3  -  .0  is  now  a  -  i  jfij.  *(  ^  )t. 


n 

r,(k) 

j=l 

r,(k) 

c4w) 

[y.    -    a(k+l)-B(k+l)(x.-x)]    =    0  (3-11) 


r,  (k) 


n     *c  -irzr  } 

fh     r    (k)         (xj-x)[yj-a(k+l)-3(k+l)(xj-x)]    =    0  (3-12) 

1      n  r. (k+1 

a(k+l)    =  i     Z     <K  ^ )    r,(k+l).  (3-13) 

J  a(k)  J 

From  equations  (3-11)  and  (3-12)  expressions  for  a  (k+1)  and 
3 (k+1)  may  be  obtained.   These  can  be  substituted  into  equa- 
tion (3-13)  to  obtain  a(k+l).   With  a  reasonably  good  guess 
for  a(0),  3(0)  and  a(0)  a  few  iterations  should  provide 
sufficiently  accurate  solutions  of  the  system  of  equations 
(3-10). 

Initial  values  for  the  parameters  a(0),  3(0)  and  a(0) 
may  be  obtained  by  least  squares  regression. 

C.   PROPERTIES  OF  THE  HUBER  ESTIMATOR 

-  R  /  1"   F 

Consider  the  model  Y  =  Ae    e  . 

Simulations  were  carried  out  with  the  above  model  for 
A  =  1,  B  =  10,  t  =  1 ,2 ,3, . . .  ,20.   To  investigate  the  properties 
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of  the  Huber  estimation  when  errors  are  long-tailed  a  "wild 
shot"  distribution  with  density  function  p  (x)  given  by 


,    ,      1     -x2/2k2,  ,       1      -x2/2k2-9  ,,   , 

pF(x)  =  -=z —  e     *(q)  +  -= e      *(i-q) 

e      /27  k  /2?  k«3 

was  used.   Four  values  of  q  were  used:   q  =  0.9,  0.825,  0.75, 
0.6.   The  values  of  k  were  then  chosen  so  that  the  distribution 
p  (x)  had  a  variance  in  the  range  0.05  to  2.0.   For  each  set 
of  parameter  values,  the  simulation  was  replicated  100  times 
to  obtain  100  values  of  A  from  which  the  sample  mean  of  A, 
and  the  sample  variance  were  obtained.   The  sample  distribu- 
tion  of  A  was  tested  for  normality  by  means  of  a  plotting  sub- 
routine described  in  Appendix  A. 

As. 

The  properties  of  the  Huber  estimate  A  obtained  from  the 
simulation  are 

1.  The  Huber  estimate  A  has  variance  which  seems  propor- 
tional to  Var(e).   Examination  of  Table  I,  Appendix  B,  indi- 
cates that  the  variance  of  the  Huber  estimator  is  smaller 
than  the  variance  of  the  least-squares  estimator. 

2.  The  Huber  estimate  A  has  an  approximate  normal  dis- 
tribution for  0  <  Var(e)<  0.5.  ■  ■ 

3.  For  the  "wild  shot"  distribution,  which  is  symmetric, 
the  Huber  estimator  seems  unbiased. 

From  Table  I,  Var(A)  =  7.23  x  10"3,  A  =  1.0056. 
For  the  hypothesis  E (A)  =  1.0 

A-1.0 
/7.23xl0"3/100 
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should  have  an  approximate  t -distribution  with  100  degrees 
of  freedom. 

The  t-test  at  0.10  level  of  significance  is 

Vos  i       I  -  L&-        <  t    .5 

/7.23xl0"3/100      u,y:) 
which  may  be  rewritten  as 


1.0  -  tQ  Q5  /7.23xl0"3/100  <  A  <  1  +  tQ  g5  /7.23xl0"3/100 


tQ  95/7.23xl0"3/100  =  0.0146 

0.9854  <  A  <  1.0146. 

The  simulated  value  of  A  of  1.0056  is  within  the 
confidence  interval  identified  above. 

4.  A  good  fit  for  the  variance  A  against  Var(e)  is 
given  by 

Var(A)  =  D  Var(e)  +  6 • [Var (e) ]2 

where  6  is  a  random  variable  which  is  approximately  normal 
for  0  <  Var(e)  <  0.5  with  E(6)  =  0.   This  is  shown  in  Fig.  5 
where  Var(A)/[Var (e)  ]2'  is  plotted  against  1/Var(c). 

5.  .  For  values  of  q  between  0.6  and  0.9,  the  approximate 
relationship  between  Var(A)  and  Var(e)  is 

Var(A)  -    0.066  Var(e) . 

This  relationship  is  obtained  from  Table  III,  Ap- 
pendix B,  by  taking  the  arithmetic  mean  for  q  =  0.6,  0.75, 
0.825  and  0.9.   The  reason  for  using  the  arithmetic  mean  of 
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the  four  slopes  is  that  they  are  quite  close  to  one  another 
(as  compared  to  the  spread) ,  and  the  number  of  replications 
(100)  was  not  large  enough  to  obtain  a  more  accurate  es- 
timate.  In  Chapter  II  the  relationship  for  least-squares 
obtained  from  theory  was 

Var(A)  =  0.084  Var(e). 

Thus  the  Huber  estimator  has  about  80  percent  the  variance 
of  the  least-squares  model. 

6.    For  assumptions  on  the  distribution  of  e  which 
represent  a  severe  departure  from  normality,  such  as  the 
Gauchy,  examination  of  Table  III. 2  shows  that  for  the  four 
values  of  the  scale  parameter  used,  the  largest  value  of 
the  variance  of  the  Huber  method  for  A  is  about  1  while  that 
for  the  least-squares  has  a  value  of  up  to  107. 
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IV.   MISSPECIFICATION  PROBLEM 

A.   LEAST -SQUARES  METHOD 

The  theoretical  values  of  the  misspecification  function 
problem  when  the  fit  is  linear  or  log  linear  can  be  obtained 
fairly  easily.   First,  assume  that  x..,x_,...,n  are  i,  i,d 

with  E(x)  =  0  and  that  the  function  f (x.. ,x~ , . . . ,x  )  can  be 

T 
expanded  in  a  Taylor  series  about  the  point  (u-,...,u  )  . 

Let  I  •  13C| , . . .  >3C_ )    =  "Tn   *-xi  '  •  •  •  '^n  * 

Then 

n 
2 


f(x1,...,xn)  =  f(y1,...,yn)  +  ^    (x.-Uj)fj(u1,...,Vn) 


thus 


and 


E[f(xlt... ,xn)]  s  f(y1,...,un) 


Var(f)  -  E[(  .|1(x.-uj)fj(y1,...,un)  )2] 

=  j§i  [fj(y1,...,yn)]2-EC(xj-yj)2] 

=  j|1  [fj(y1,...,yn)]2.Var(xj) 

-  VarCx)-^  [  fj(y1,...,yn)]2. 
Now,  suppose  the  observed  data  is  from  the  model 

e! 

Y!  =  1.0  *    ^*J  •   e  J  where  c  =  0.0772 
J       1  +  c-j 

but  the  model  used  to  fit  it  is 
Y.  =  Ae"B/J  e^. 
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Then 


Ej  =  In  y.    -    In   A  -  B/j , 


n   2 


and  least-squares  demands  minimization  of  -1-iE- 
The  observed  values  of  the  y.  are  y! .   Hence 

£j    =   An(1.0   jf^J  eeJ)    -    Jin  A   -    B/j 


■   *n(    rr-^  •    )    +   e!    -   In  A  +   B/j . 
v   1+c* j    J  j  ' J 

Defining   L(A,B)    as 


n        2 


L(A,B)    =   ^   e? 


=  ^UnC   1+c.j    )    +   ej    -   An  A  +   B/j]2. 

Differentiating  this  function  with  respect  to  A  and  B  and 
setting  equal  to  zero  results  in 

3L     3L  n 


SA~ 


i   jhUn(ITc^J^  +  ej  "  £n  A  +  B/J]  =  ° 


The  least-squares  solution  for  In   A  is 

(4-2) 


AhA   = 


n1  n  r  •  i  n1n1  r«  i     -. 

v]  =  l    ]  ^    J     .1  =  1       i 1  +  cj  3  =  1    3       3  =  1    1       3  1  +  C-j 

n      -  n      1  n      i 

n    (    .E,    4-)    -    (    .L    i)(    .E.    4) 
J  =  l    J2  J  =  l    J  J  =  1    J 


If  the  e.  are  assumed  to  be  iid  with  E(e.)  =  0  and  Varfe.) 
small,  then  the  Taylor  series  approximation  gives 
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E(£nA) 


(4-3) 

(  .Z~  i-  )(.£..  &n.,^'J  ■)  -  (..£-  i)(.E,  i  £n.,c'J  .  ) 
3  =  1  j  *  -,v3  =  l    1+cj^    *•]  =  !  ]JK3  =  1    3    1  +  cj  ^ 


n   1   w^   .c-j,      »   lw  *   1 


n   1         n   ., 
n(  -E1  i=-  )  -  (  .S,  i  )2 


For  the  variance  of  ink 

n   1         n   1   1 

*r        C  -2-,  4-  )  -  (  .Z-  i  )•£■ 

|f-  CO)  =    J  =  1  J2  L  J-l  J  J  E  (4.4) 

3XV  n   -,        n   1 

K       n(  -E,  ±5-  )  -  (  .S,  4  )2 

Using  (4-4)  the  variance  for  &nA  becomes 

Var(AnA)-  Var(X)  j|1  (  ^  (0))2 

and  (4-5) 

Var(A)  a   eEUfiA]-Var(£nA). 

1 .   Comparison  of  Theoretical  and  Simulated  Results 
For  observed  data  from  the  model 

Y!  =  1.0  ..f'J  .  e€J  c  =  0.0772 

J       l+c«j 

j  =  1,2,. .. ,n         Var(e)  =  0.072 
The  theoretical  values  are 

E(fcnA)  =  -  0.576& 
E(A)    =    0.5617 
Var(inA)=    6.055  x  10"3. 
The  observed  values  for  computer  simulation  are 


(AnA)=  -  0.580 
Var(£nA)=    6.04  x  10~3. 
Normality  plots  not  included  with  this  thesis  indi- 
cated that  Jin  A  was  distributed  approximately  normal.   Hence 
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AnA  -  (-0.5768) 
/O. 00604/100 

has  an  approximate  t  distribution  with  100  degrees  of  freedom. 

The  confidence  interval  at  the  0.10  significance 
level  is  given  by 


<   JlnA  -  (0.5768)  <  t 
0,05  "    /0. 00604/100   "   °*95 


or 


0.5901  <  £nA  <  -  0.5635. 


The  observed  value  from  simulation  was  JlnA  =  -  0.580 
which  is  well  within  this  confidence  interval. 

B.   WEIGHTED  HUBER  ESTIMATOR 
1.   Model  Y  =  Ae~B/te£ 

Quite  often  weights  {w . }  are  given  to  the  jth  obser- 
vation in  order  to  reduce  bias  or  the  mean  square  error  when 
it  is  suspected  that  there  is  misspecification  error  in  the 
model.   The  equations  (3-10)  are  modified  to  read 

n 


j  =  l   j  T  v  a  J 

n        r,        _ 

r  w.  ^(  _J_  )  (X.  -  X)  =  0 

,ii«,W(Il-)(  Ij.)  -  I]-  o 


and  the  method  of  iteration  can  again  be  used  to  solve  these 
systems  of  equations  as  before. 
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2.   Model  Y  =  Ae"B/t  e£ 

Since  quite  often  better  results  can  be  obtained  by 
modifying  the  original  model  by  the  introduction  of  an  ad- 

-  B/1"   £ 

ditional  parameter  the  model  Y  =  Ae   '  e  was  modified  by  to 

-B/tc  £ 
read  Y  =  Ae   '   e  .   The  following  is  a  derivation  of  the 

weighted  Huber  and  Least  Squares  estimators  for  this  model. 
a.   Weighted  Huber  Derivation 

The  weighted  likelihood  function  for  the  obser- 
vations is 

•n       £ny.  -  £,nA  +  B/t^     ,,     -, 

jilt  p  C  -^— ; 1-  )  3W:  (  I  )w3  . 

For  the  purpose  of  simplifying  notation  replace  JlnA  by  A 

and  Any.  by  y..   Then  the  log  weighted  likelihood  function 

is 

n          y     -  A  +  B/t* 
L  =  .E.,[w.  Jlnpf  — * L  )    -   w.  ana]. 

Differentiating  L  with  respect  to  A,  B,  c  and  a  and  setting 
equal  to  zero  results  in 

|L  =  5      c  Pi  j  (  "I  }  =  0 

9^   j=l   j  *•   p  '  *•   a  ■* 

It  =  -Si  »■  C  ^  j  —  -  o 
**   J  =  1  J    p   atc 

|L  =  .|  w.  (  Pi  }  JL     c  ^!l  )  -  o 

3c    j=l   J     P    tC   v    a   ' 

J 

3L 


n       n,      y,  -  A  +  B/t?     w. 


Let  Hz)  =  -  fil[|}.- 
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Then  the  above  equations  can  be  written  as 

n  w.     y .  -  A  +  B/tJ 

*        j=l  c  rK  a        J 


n  w.    y.  -   A  +  B/t*: 
M   j=l  c  Vl      a        ;  (4-6) 

n  w.  in  t.     y.    -   A  +  B/t^ 

r  =  .2..  -J 1  ,|;(  -J 1  )  =  o 

j  =  l     c     rv-      a        ' 

j 

n        n  y.  -  A  +  B/t*: 

s  =  a  .J-  w.  -  .£.,  w-(y.  -  A  +  B/t.)iK  -J L_  )  =  o 

3  =  1   j    j  =  l   j^j  j^rv-       a        J 

The  unknown  parameters  A,  B,  c  and  a  are  the 
solutions  to  the  system  of  non-linear  equations  (4-6)  which 
can  be  solved  by  Newton's  method  of  iteration.   To  simplify 
notation  let  r.  =  y.  -  A  +  B/t'r.   Then 

ft-  jfii.Vr!)*'^) 

j 

-„    n     t,    -£n  t  -       r . 

j 

jfc-'.L  w.  2-  (    i  ■)  rc  li) 

8a    j  =  l   J  tc    "a2        a 


3 


n  w, 


3A    j  =  l   c   v   a  '  r  *■   a  ' 


-     n  w.    1      r . 

3B    J=1  tC   atc      a 
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St- 


n      w;      B        -An   t. 


!i 


fii*  fc-^-1- )*'(-£) 


n     w.      r 


r . 
_1 


jJii  pin  ♦^-t1 


3r 
3A 


n     w.Ant.  1  r. 


3r 
SB 


n     w.Ant. 

■?i  J — i 

j  =  l        ..c 


at 


c    *'C  -J  3 


3c 


n     w.Ant.  t,        -An   t.  r. 

.S1  -J — I  -  ( I )  *•(  -J- ) 

j  =  l  c  a  *•        .c        J  Y    v      a   -* 

t  *  L  ■ 


3r  »     w/ntj 

3a   "    j=l 


r .  r . 


(-a*) 


K-"j«l    CwjC-WC^)    *w.r.(  Zi  )*.(!!)] 


3s 

3B 


n  1  ri  1  ri 

-.2-    [w.    —  ip  C  — - L  )    +   w.r.    -±-     ij/f(  -2-  )] 
j  =  l        j      c  n     a  J  j    j      tc      r  a 


3s 

3c 


n  (-Ant   )  r. 

Zn    [w.B     ■!—  "i|>(   -J-  )    +  w.r 


j=l    L"j 


tC 
J 


J    J    a 


R    (-Ant.)  r. 


3s 

3a 


n  n  r.  r. 

=    .Z,    w.    -    .2-    [w.r.    , — k    i|>'(   -J-  )] 


Let    z    =    (z1  ,z7,z,,z.)       =    (p,q,r,s) 


1»*2»    3»   4- 

1»X2,X3,X4 


T  T 

x   =    (x^x-.x^x.)      =    (A,B,c,a)     . 
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Then  the  iterations  are  given  by 


Vi  =  Ai  +  AAi 


B-,..  =  B-  +  AB. 
l+l     1      x 


c..,,  =  c  +  Ac. 
1+1    1     1 


ai+l  =  ai  +  Aai 


where  the  A's  are  the  solution  of  the  equation 


—                             -  . 

AA. 

l 

AB. 

l 

Ac 

l 

Aa. 

l 

b.   Weighted  Least-Squares  Derivation 

The  weighted  least-squares  estimator  for  the  model 

Y  =  Ae-B/tV 
lead  to  the  normal  equations 


n  R 

p  =    .£  vi.  liny.    -    Ink   +   ^—1    =    0 

t . 
J 


n 


B 


q  =  .£.,  w.  —  [iny.  -  ink   +  —  ]  =  0 
3=1  j  c    ^         c 

J  3 
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r  =  -S-  w.  -i  int. [Any.  -  ink   +  -|  ]  =  0 


and  the  iterations  are  given  by 


ci+l   =   Ci 


Any •  •     w •                            w . 

r  n  J    -    r onAI  .      n  J      +   B        n     ^ 1 

L.Z..          t.c         ^nAJi  r      t.c.           1    .Z..    t.2c      J 

3  =  1             j    l  j  =  l     j    l               j  =  l      j      i 

n  Ant. 

[    -    B.     .Z,  w.    - — i-  ] 

l   j  =  l  j    tjC;L 


n     w .  Any .  n         w .  n  w . 

[.Ei    t1 *■   -    (AnA).     .Z..    - 3 +   B.     .Z,    — -^ 

j  =  l   t.c...,         *■        Ji   j  =  l   t-c^-,  i    i  =  l   t.2c_,. 

B.    ,    =   B.   -— J    1+1 - J    1  +  1 - 3 ii 

l+l  l  ,  n  w. 

Z,    «— L 


L    (XnATi      j=l    C^c^)2    J 

n     w. Any   Ant,  n     w.Ant.  n         w, 

[.£-    -£ ■* J-   -    (AnA) .     -Z,    ^ J-  +    B.     ,     -Z,    -r-*i 

LJ=1      t.c.+1  <■        Ji    j=l   t.c.    -  i+l   j-1   t,2c 

CAnA)  .      =  (ink)  . Llii l-lli L_ 

n        w.Ant. 

J  j    i  +  l 

C.   COMPUTER  SIMULATION  OF  THE  MISSPECIFIED  MODELS 

Bt 
The  data  analyzed  was  generated  from  the  model  Y  =  1.0  1 +Rt  e 

where  B  =  0.0772  with  var(e)  =  0.1,  0.2  and  0.3  initially.   The 

value  of  B  was  chosen  so  that  the  expected  values  have  a  range 

from  0.07  to  0.60.   The  values  for  t  were  from  one  to  twenty. 

The  sample  mean  A  and  sample  variance  Var(A)  were  calculated 

for  a  sample  size  of  100.   The  weighting  system  chosen  was 

r-^    in-   -1.5   .2.0   n  „(20-j)   n  oc(20-i)  •     , 
w(j)  =  1.0,  j,  j    ,  j    ,  0.7^    J J  ,  0.85^    J '    in  order  to 

find  weights  which  show  promising  results  so  as  to  concentrate 

the  analysis  on  the  interesting  cases. 
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1.   Numerical  Results 

Preliminary  examination  of  Tables  VI,  IX,  and  X  show 

that 

-B/tC  £ 

1.  For  the  least-squares  fit  to  Y  =  Ae   '   e   the 

expected  value  of  A  is  practically  independent  of  the  system 
of  weights  chosen  with  E (A)  approximately  equal  to  1.30, 
which  is  quite  surprising. 

-  C  / 1  £ 

2.  For  the  same  model  Y  =  Ae   '  e   the  least-squares 
method  and  the  Huber  method  have  approximately  the  same  ex- 
pected value  and  variance  for  low  weights. 

3.  For  heavy  weighting  systems,  the  bias  of  the 
Huber  method  is  considerably  less  than  the  bias  of  the  least- 
squares  method. 

4.  The  iteration  for  the  Huber  method  with  the  model 

-B/tc  £ 
Y  =  Ae     e   for  var[e)  -  0.2  had  some  peculiar  features. 

Specifically, 

a.  About  eighty  to  ninety  percent  of  the  simu- 
lations with  different  random  number  seeds  did  not  result  in 
convergence. 

b.  Examination  of  Table  V  appears  to  show  that 
the  system  of  non-linear  equations  for  the  Huber  method  have 
multiple  solutions. 

c.  When  the  initial  starting  values  for  the 
Newton  iteration  are  the  convergent  values  of  one  of  the 
sequences,  but  if  a  different  seed  is  used,  divergence  of 
the  iteration  still  usually  occurred. 
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The  probable  cause  of  the  divergence  for  the  itera- 
tion of  the  Huber  method  for  the  mis-specified  model  is  that 

the  var(e)  chosen  was  too  large.   One  of  the  difficulties  of 

-B/t^~  £ 
the  Huber  method  for  the  model  Y  =  Ae   '   e   is  chosing  a 

suitable  set  of  parameters  (4)  as  the  initial  starting  values 

for  the  iteration.   Usually  it  is  quite  difficult  to  chose 

even  three  suitable  initial  values. 

As  a  result,  it  was  decided  to  concentrate  further 

analysis  of  the  mis-specified  problem  using  heaving  weighting 

-B  / 1   E 

systems  with  the  Huber  method  for  the  model  Y  =  Ae   '  e   as 
these  gave  the  least  bias.   Also,  as  the  initial  value  of 
var(e)  used  was  too  large  to  be  practical,  the  values  of 

var(c)  was  reduced  to  var(e)  =  0.005,  0.01,  and  0.02.   The 

.  ...       .      .  ,..    .1.5   .2   .3   .4     oc(20-i) 

weighting  systems  chosen  were  w(jj  =  j    ,  j    ,  j  ,  j  ,  o.85^   J *  , 

Examination  of  Tables  VII  and  VIII  shows  that  the  sys- 
tem which  weighted  the  later  data  values  heavily  and  early 
data  values  very  lightly  still  gave  the  best  results.   The 
weighting  system  given  by  w(j)  =  j   has  the  smallest  bias  and 
mean  square  error  although  it  had  an  estimator  A  with  the 
largest  variance. 

2 .   Individual  Curve  Fitting  Trials 

The  following  curve  fitting  experiments  were  performed 
for  the  Huber  method  and  the  least-squares  method  for  the 

-  c/ 1  £ 

model  Y  =  Ae  e  with  data  generated  from  the  model  Y  =  1.0 
(B*t/1+B«t)e  with  parameter  values  previously  mentioned.  Two 
curves  were  plotted  in  each  figure.   The  curve  which  has  the 
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smaller  value  of  y  for  small  values  of  t  is  the  fitted  curve, 
The  second  curve  is  the  expected  value  of  T  for  the  data 
generated.   The  figures  are: 

1.  6-13  var(e)  =  0.005 

2.  14-21  var(e)  =  0.010. 

The  unweighted  least-squares  curves  (Figures  6,14) 
were  obviously  bad  fits.   Comparison  of  the  various  figures 
show  that  in  general  the  heavier  weighting  systems  gave 
better  fitted  curves  for  large  values  of  t  and  poorer  fits 
for  small  values  of  t. 
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V.   DISCUSSION 

A.   JUSTIFICATION  FOR  HUBER  METHOD  ; 

- B /t  e 
For  the  currently  specified  model  given  by  Y  =  Ae   '  e 

with  E(e)  =0,  the  Huber  method  has  a  slightly  smaller  vari- 
ance than  least-squares  for  the  random  variable  e  consisting 
of  a  mixture  of  two  normals.   For  Var(e)  <  0.5,  the  variance 
of  the  Huber  estimator  A  is  approximately  normal.   Thus  the 
Huber  estimator  of  A  is  a  better  estimator  than  least-squares 
for  long-tailed  distributions.   For  non-symmetric  distribu- 
tions of  e   the  least-squares  and  Huber  methods  are  compar- 
able (see  Table  IV) . 

Another  possible  objection  to  the  least-squares  method 

-B/t   £ 

for  the  fit  Y  =  Ae    e   is  that  very  often  it  is  not  known 
what  the  true  model  is.   The  least-squares  method  does  not 
seem  robust  against  a  mis-specified  model,  judging  from  our 
experiments.   Thus  the  Huber  method  might  well  be  preferred 
to  the  least-squares  method  when  the  true  model  is  not  known, 
judging  from  the  experiments  carried  out  to  date. 

-B/t   E 

Another  variation  of  the  model  Y  =  Ae   '  e   is  Y  =  A* 
e-B/t+kee^   For  the  data  y  =  1  Q  (Bt/1+Bt)ee  was  considered. 

This  model  did  not  appear  promising  for  the  following  rea- 
sons: 

1.   Comparing  the  plots  for  the  various  methods  of  fit 

-B/t  F 
for  Y  =  Ae    e   shows  that  the  fitted  curves  were  too  flat 

as  compared  to  the  curve  Y  =  1.0  (Bt/l+Bt)  for  values  of  t 

satisfying  12  <  t  <  20.   Since  the  parameter  k  was  introduced 
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to  match  more  closely  the  slopes  of  the  fitted  curve  and  the 
data  for  values  of  t  between  say  15  and  20  as  well  as  the  y 
values,  this  implies  that  k  would  have  to  be  negative.   How- 
ever, the  function  y  =  Ae   '     has  an  infinite  discontinuity 
at  t  =  -k.   Thus  values  of  k  <  -1  are  not  reasonable  for  the 
range  of  values  of  t  considered  above.   One  way  of  overcoming 
this  difficulty  would  be  to  discard  the  observations  for 
0  <  t  <  5,  since  the  future  values  are  less  dependent  on  the 
distant  past  observations  than  those  observations  which  are 
more  recent. 

B.   AREAS  OF  FURTHER  STUDY 

1.  Since  the  exact  form  of  the  growth  is  not  known, 
further  investigation  in  this  area.   For  example,  the  model 

B 1"      F 

used  to  generate  the  data  in  this  thesis  was  Y  =  A" ..  +R   e  . 
However,  there  is  no  reason  to  believe  that  Y  =  A(l-e    )e 
or  any  similar  growth  model  could  not  have  been  used. 

2.  The  range  of  values  for  t  was  from  one  to  twenty 
(1-20).   Other  ranges  on  t  need  to  be  investigated. 
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APPENDIX  A:   SUBROUTINE  NMPLOT 

The  subroutine  NMPLOT  was  used  as  an  indicator  as  to 

whether  a  set  of  n  observations  x1,xOJ...,'x  come  from  a 

1  2  n 

normal  distribution.   To  carry  out  the  test',  the  numbers 


X1,x2,...,x   are  sorted  in  increasing  order  say  y-i,yo,...,y  . 

] 

J 


_   i   n 
The  sample  mean  y  =  —  .  £..  y-  and  the  sample  variance       _ 

y .  -  y 

s2  =  — r  -.kt    (y-  "  y) 2  are  then  calculated.   Let  z-  =  — ' 

n-1  j  =  1  w  j    '  '  3      s 

If  the  original  set  x- , . . . ,x  were  normal,  then  for  rather 
large  n  (at  least  50)  the  set  z.,  j=l,...,n  should  have 
properties  similar  to  that  of  the  ordered  statistics  from  a 
standard  normal  distribution.   Let  $  be  the  cumulative  dis- 
tribution function  from  the  standard  normal.   Then  a  plot 
of  j/n  versus  $(z.)  should  lie  approximately  on  a  straight 
line  passing  through  the  origin  with  slope  one.   To  decide 
whether  the  sample  x-,...,x   is  approximately  normal,  a  plot 
obtained  from  n  observations  from  a  standard  normal  and  the 
two  plots  compared.   The  subroutine  is  part  of  the  computer 

-  Rt  £ 

program  for  the  weighted  Huber  method  for  the  model  Y  =  Ae   e 
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Y  =  1.0  e 

-10/t  Qe 

q=0.6 

q=0.75 

q=0.825 

q=0.9 

Var(e) 

Var (A) 

Var (A) 

Var (A) 

Vaf (A) 

0.1 

0.0060 

0.0058 

0.0072 

0.0068 

0.2 

0.0144 

0.0118 

0.0145 

0.0156 

0.3 

0.0257 

0.0254 

0.0235  ' 

0.0209 

0.4 

0.0222 

0.0197 

0.0250 

0.0241 

0.5 

0.0327 

0.0181 

0.0255 

0.0329 

0.6 

0.0393 

0.0273 

0.0345 

0.0434 

0.7 

0.0458 

0.0489 

0.0566 

0.0490 

0.8 

0.0492 

0.0468 

0.0451 

0.0508 

0.9 

0.0668 

0.0515 

0.0679 

0.0553 

1.0 

0.0512 

0.0876 

0.0734 

0.0683 

1.1 

0.0697 

0.0552 

0.0802 

0.0681 

1.2 

0.0871 

0.0427 

0.0614 

0.0939 

1.3 

0.0807 

0.0588 

0.0911 

0.0909 

1.4 

0.0752 

0.1080 

0.1017 

0.1340 

1.5 

0.1381 

0.0789 

0.0888 

0.1530 

1.6 

0.1091 

0.1060 

0.0858 

0.1389 

1.7 

0.0933 

0.0860 

0.1008 

0.1214 

1.8 

0.0982 

0.1700 

0.1071 

0.1970 

1.9 

0.1493 

0.1330 

0.1270 

0.2070 

2.0 

0.1685 

0.1730 

0.2015 

0.1650 

Slope 

0.0641 

0.0593 

0.071 

0.070 

Table  1 1 1 . 1 .   Variance  for  the  Huber  Method  Wild  Shot 
Distribution . 
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e  is  mixture  of  two  distributions 

Z1  with,  probability  0.9 

Z  with,  probability  0.1 

X  is  the  standard  normal 


HUBER 

LEAST 

SQUARES 

P 

A 

Var(A) 

A 

Var  (A) 

h 

0.0707 

1.020 

0.00100 

1.021 

0.00099 

0.25 

+  pX 

0.1 

1.029 

0.00147 

1.030 

0.00147 

0.1414 

1.030 

0.00218 

1.032 

0.00215 

0.0707 

1.023 

0.00102 

1.024 

0.00101 

V°- 

25 

0.10 

1.030 

0.00142 

1.030 

0.00141 

0.1414 

1.020 

0.00203 

1.020 

0.00201 

Table  IV.   Comparison  of  Least  Squares  and  Huber  Methods  for 
Non-Symmetric  Distributions. 
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Table  V.   Convergent  Sequences  for  the  Huber  Method  with 

Mis-specif ied  Model. 

-B/tc  e 
Y  =  Ae     e   with  weights  w(j)  =  1 

Iteration     ( AnA) .        B.  c.        a. 

*•   ■'l         1  1         l 

1        0.2000         3.000  0.5000     0.8000 


16  -0.1083  3.6682  0.7245  -18.179 

17  -0.1086  3.6678  0.7246  -18.072 

18  -0.1086  3.6678  0.7246  -17.965 

19  -0.1086  3.6678  0.7246  -17.858 

15  0.7872  3.1258  0.2924  9.006 

16  0.7969  3.1349  0.2911  8.226 

17  0.7971  3.1351  0.2910  7.437 

18  0.7971  3.1351  0.2911  6.649 

19  0.7971  3.1351  0.2911  5.862 

20  0.7971  3.1351  0.2911  5.076 

• 

15  0.0912  2.6268  0.4214  0.8348 

16  0.0912  2.6268  0.4214  0.7991 

17  0.0912  2.6268  0.4214  0.7657 

18  0.0912  2.6268  0.4214  0.7348 

19  0.0912  2.6268  0.4214  0.7064 

20  0.0912  2.6268  0.4212  0.6803 

• 
• 

15  0.3407  3.2417  0.4544  0.1975 

16  0.3346  3.2353  0.4560  0.1929 

17  0.3360  3.2367  0.4557  0.1939 

18  0.3356  3.2363  0.4558  0.1936 

19  0.3357  3.2364  0.4557  0.1937 

20  0.3357  3.2364  0.4558  0.1936 
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Y   =    1.0 

Bt        e             . 
1+Bt    6               b    = 

i    0.0772           q   = 

=    0.9 

w(j) 

Var(e) 

Var(A) 

A 

M.S.E 

1 

0.10 

0.00041 

0.569 

0.186 

3 

0.10 

0.0055 

0.681 

0.107 

.1.5 

0.10 

0.0123 

0.697 

0.104 

J2 

0.10 

0.0220 

0.740 

0.090 

0.7020"J 

0.10 

0.0414 

0.761 

0.098 

0.852°-J 

0.10 

0.0038 

0.655 

0.123 

1 

0.20 

0.0154 

0.560 

0.195 

J 

0.20 

0.0149 

0.663 

0.128 

,1.5 

0.20 

0.0325 

0.722 

0.110 

.2 
3 

0.20 

0.068 

0.78 

0.116 

0.702°-J 

0.20 

0.127 

0.839 

0.153 

0.8520^" 

0.20 

0.0138 

0.674 

0.120 

1 

0.30 

0.0209 

0.570 

0.206 

J 

0.30 

0.0183 

0.645 

0.144 

.1.5 
3 

0.30 

0.0344 

0.701 

0.124 

i2 

0.30 

0.066 

0.754 

0.127 

0.7020^ 

0.30 

0.199 

0.852 

0.221 

0.852°-3 

0.30 

0.0134 

0.663 

0.127 

Table  VI.   Weighted  Huber  Method  with  Mis-specified  Model 
Y  =  Ae"c/tet. 
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Y  =  1.0 


Bt 
1+Bt 


B  =  0.0772 


q  =  0.9 


w(j) 

Var(e) 

Var (A) 

A 

M.S.E. 

0.7020-}' 

0.005 

0.00333 

0.757 

0.0629 

0.8520^ 

0.005 

0.00043 

0.662 

0.115 

.1.5 

0.005 

0.00056 

0.710 

0.0847 

J2 

0.005 

0.00118 

0.749 

0.0642 

0.7020"J 

0.01 

0.00503 

0.756 

0.0646 

0.852°-J 

0.01 

0.00087 

0.664 

0.114 

.1.5 

0.01 

0.00121 

0.718 

0.0807 

i2 

0.01 

0.00154 

0.750 

0.06'40 

0.7020'J 

0.02 

0.0119 

0.781 

0.0600 

0.852°-J 

0.02 

0.00117 

0.659 

0.117 

.1.5 

0.02 

0.00253 

0.707 

0.0883 

J2 

0.02 

0.00432 

0.742 

0.0709 

Table  VII.   Weighted  Huber  Method  with  Mis-specified  Model 
Y  =  Ae"c/t  e£. 
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Y  =  1.0 


Bt 

1+Bt 


B  =  0.0772 


q  =  0.9 


w(j) 
^3 
4 
3 

4 
3 
4 


Var(e) 

0.005 

0.005 

0.01 

0.01 

0.02 

0.02 


Var(A) 


0.0033 
0.0043 
0.00  35 
0.0077 
0.0092 
0.0179 


0.795 
0.835 
0.796 
0.816 
0.790 
0.839 


M.S.E. 

0.0453 
0.0315 
0.0451 
0.0416 
0.0533 
0.0438 


Table  VIII.   Weighted  Huber  Method  with  Mis-specified  Model 
Y  =  Ae"c/t  ee 
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Y  =  1.0 


Bt   e 

e 


1  +  Bt 


B  =  0.0772 


q  =  0.9 


w(j) 

Var(e) 

Var(A) 

A 

M.S.E 

1 

0.10 

0.00430 

1.30 

0.094 

j 

0.10 

0.00415 

1.33 

0.113 

J1-5 

0.10 

0.0067 

1.30 

0.097 

J2 

0.10 

0.0074 

1.29 

0.092 

0.7020' 

"J 

0.10 

0.00683 

1.26 

0.074 

0.8520- 

•J 

0.10 

0.0030 

1.30 

0.093 

1 

0.20 

0.00896 

1.28 

0.087 

J 

0.20 

0.0126 

1.34 

0.128 

.1.5 

0.20 

0.0146 

1.30 

0.105 

J2 

0.20 

0.0182 

1.32 

0.121 

o.720-: 

i 

0.20 

0.0154 

1.25 

0.078 

0.8520" 

•J 

0.20 

0.0140 

1.32 

0.116 

1 

0.30 

0.0165 

1.28 

0.095 

J 

0.30 

0.0130 

1.34 

0.129 

j1-5 

0.30 

0.0179 

1.31 

0.114 

iz 

0.30 

0.0268 

1.29 

0.111 

0.7020' 

•j 

0.30 

0.0361 

1.27 

0.109 

0.8520" 

■J 

0.30 

0.0139 

1.31 

0.110 

Table  IX.   Least-Squares  Method  with  Mis-specified  Model 
Y  =  Ae-D/tC  eE 
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Bt 


,w    1+Bt 

•  V  /  /  t*            4     -     V. 

w(j) 

- 

Var(e) 

Var(A) 

A 

M.S.E 

1 

0.10 

0.00285 

0.566 

0.191 

j 

0.10 

0.00526 

0.654" 

0.125 

.1.5 

0.10 

0.00685 

0.673 

0.114 

J2 

0.10 

0.0152 

0.738 

0.084 

0.7020- 

"j 

0.10 

0.0194 

0.755 

0.079 

CSS20" 

-j 

0.10 

0.00677 

0.652 

0.129 

1 

0.20 

0.00517 

0.572 

0.188 

j 

0.20 

0.0116 

0.654 

0.131 

.1.5 

0.20 

0.0214 

0.711 

0.105 

.2 
3 

0.20 

0.0200 

0.694 

0.114 

0.720"-' 

i 

0.20 

0.0599 

0.741 

0.127 

0.8520- 

•j 

0.20 

0.0139 

0.658 

0.131 

1 

0.30 

0.00831 

0.570 

0.193 

j 

0.30 

0.0165 

0.668 

0.127 

.1.5 

0.30 

0.0181 

0.673 

0.125 

J2 

0.30 

0.0429 

0.751 

0.105 

0.7020- 

■j 

0.30 

0.0597 

0.733 

0.131 

0.8520" 

■j 

0.30 

0.0230 

0.658 

0.134 

Table   X.      Least-Squares   Method  with  Mis-specified  Model 
Y   =   Ae"c/t   ee 
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Figure  1.   Comparison  of  Variances  of  Huber  and  Least-Squares 
Estimator,  var(e)  <  0.5. 
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Figure  2.   Linear  Fit  for  Variance  of  Huber  Estimator  for 
q  =  0.9. 
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Figure  3.   Linear  Fit  for  Variance  of  Huber  Estimator  for 
q  =  0.825. 
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Figure  4.   Linear  Fit  for  Variance  of  Huber  Estimator,  for 
q  =  0.60. 
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Figure  6.   Unweighted  Least-Squares,  Var(e)  =  0.005. 
A  =  0.572. 
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Figure  7.   Unweighted  Huber,  Var(e)  =  0.005,  A  =  0.572. 
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Figure  8.   Weighted  Least-Squares,  var(e)  »  0.005,  w(j)=j2 
A  =  0.745. 
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Figure  9.   Weighted  Huber,  var(e)  *  0.005,  w(j)  =  j2, 
A  =  0.773. 
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Figure  10.   Weighted  Least-Squares,  var(e) 
A  =  0.797. 
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Figure  11.   Weighted  Huber,  var(e)  =  0.005,  w(j)  =  j3 
A  =  0.810. 
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Figure    12.      Weighted  Least-Squares,    var(e)    =.0.005,   w(j)=j 
A  =    0.824. 
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Figure  13.   Weighted  Huber,  var(e)    =   0.005,  w(j)  =  j* 
A  =  0.828. 
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Figure  14. Unweighted  Least-Squares,  var(e)  =  0.10,  A  =  0.548. 
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Figure  15. Unweighted  Huber,  var(e)  =  0.010,  A  =  0.548. 
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Figure  16.   Weighted  Least-Squares,  var(e)  =  0.010,  w(j) 
i      ~  =  j  ,  A  =  0.664. 
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Figure  17.   Weighted  Huber,  var(e)  =  0.010,  w(j)  =  j2 
A  =  0.678. 
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Figure  18.  Weighted  Least-Squares,  var(e) 
j2,  A  =  0.695. 
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Figure  19.   Weighted  Huber,  var(e)  =  0.01,  w(j)  =  j2, 
A  =  0.694. 
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Figure   20.      Weighted  Least-Squares,   var(e)    =   0.010,   w(j) 
-  j',  X  -   0.691. 
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Figure  21.   Weighted  Huber,  var(e)  =  0.010,  w(j) 
A  =  0.691. 
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